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(54) Digital video editing method and system 



(57) A video editing system has the functions of: a) 
scene browsing with next and back icons and/or a scroll 
bar; b) recursive scene segmentation available with the 
browsing function; c) scene/clip specification with a 
reversing option (in case of a system with two display 
areas ); d) recursive scene grouping; d) scene clipping 

FIG. 3 



based on selection by default; e) clip sorting in order of 
time or in a specified order; f) relative position restora- 
tion of a specified scene (in case of a system with a sin- 
gle display area); g) clamping a scene to its original play 
time; and h) scene transition processing. 
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Descriptton ?> ' ""'"' • r \ ; '-'' x5 / : ' > ; ' :> "-'^ f: - ' -- : -^ v; - ^ ^ ' ? - *■ - •■• i ■' 

BACKGROUND OF THE INVENTION — -v*..v : : "••'- - 1 ? : J , ; 

5 1 . Field of the invention' ' _ ' ; " \ : ' ? ' ; ' '\' : *f - :V vsy.^.-:,* M . 

[0001] The invention generally relates to a digital video editing method and system and; more particularly, to a method 
and system for assembling an edited program from one or more digital video source material taken in from a video cam-: 
era, storage media and/or transmission media by sel^bting and 6rdering T segmerits "(or scenes) of the video source 5 
10 materials. ./ : 'V/.'" j> * ~* " '*> * Y ^ t '-'> ? -"V"* : •' • ! '• -h ^- 

2. Description of the l^rior Art . ^^ : ; .: • «. : .■}■■• ' :v* ■ * -* ': . „ ^ 1 

[0002] '-'lis.' Patent ^5,^7^6" issued' Ouiy-'ife, 1996 discloses a 't^c^' method- for editihg video comprised of a 
is sequence of video segments by locating segment boundaries and reordering segment sequences. Frames associated 
with sequences df video source material representing a series of scene changes are digitized! The digitized information 
is anal yzed'tb identify one or more f rames of the source material associated with and representative of each such scene 
change and/or sequence. The representative frames are displayed. A selected frame from the display will thereby 
cause automatic selection and association of a sequence of frames. The corresponding frames of video segments or 
20 scenes corresponding to each such selected and ordered representative frame are thereby automatically also ordered: 
Sit^lified video ^itingjis accomplish each associated with a' different 

scene or video sequence.' " t: """'"' *"'''' f " " ,: "'"^ ' >c ' ' ' : ** " ; ■ "' v? '*"• x 

[0003] , U.S. Patent 5.237,648 issued Aug. 17, 1993 discloses ^Ajpparatus'a 

selecting and displaying video clip In the editing system, the user is presented with a video window for displaying thef 

25 video information, a control window ' for regulating [ playback of the video ihforrnation, ' arid a clip list window having a 
number of rpws of edit windows organized under begin, end, and clip columns. The user can generate video clips ahd J 
change the clips by dicking on tfie desired video frame to generate ^a small digitized version" bf the frame' and moving 
the snrialijdigitized frame from t^ • * f - ■"" ^ r — 

[0004] U.S. Patent 5,218,672 issued June 8; 1^3 discloses V 

30 unedited video takes in a random access memory (a set of laser video disk players), displaying selected takes (or indi- 
vidual frames from selected, takes) arid generatingan edrf list program. The user can 
include, in the edit list, definitions of various vbeo transitions between scenes, such as dissolves, fades, and wipes. " 
[OObsl , However, prior art video editing systems provide 1 only ^ either selection or elimina- 
tion of a specified video scene. In some cases, it will be desirabie'to specify and select a necessary portion, and in other- 

35 cases, it may be desirable to specify and eliminate an unnecessary portion. It is therefore an object of the invention to 
provide a video editing) systerh which permit the Liser; to issue a desir^ one of selection and deletion commands for a 
specflied. object/ '.V ''.]; H * V ■ - - '■>-■*" : J v*-';. - ■'■ ■ ■ ■ • . i:\ 

[0006] The above and other prior airt video edrting systems usually so-called undo function. Issuing some undo 

commands dia certkin edrting state ^ cai^es We cuijeht editing state to be restored to the previous edrting state by each 

40 of the issued undo oommdhda HdyveVer, it may be sometimes desired to restore a specific scene to its last relative pbsi- 
tioh in order with respective to the scene which wa& scene in order before the specific^ 

scene has taken the current position. Therefore, It is another q^ed of the invention tb provide a video editihg sysienv 
having a restore function of restoring a spedfied scene to its last relative position in order with respective to the scene 
which was just before or after the spebif ic scene iri order before the specific* scene has taken the current position. y 

45 [0007] In the above arid other jbrior art video editing syslerris, a series bf frames or a scene is c dealt with as an editihg 
unit (or ja clip). However, there are sbirnetimestw of ^r<e ^Wnes 1 that 'the user desires tb manipulate as a single clip 
though the scenes are discontinuous in time or defivecl'f rbnVc?rfferent source videos, therefore, it is further object of the 
invention to provide a video editihg systenri which hot bhiy permits the user to group two or more scenes together to 
make the grouped scenes a clip but also pro\^des various improved and novel functions such as enhance the user's 

so convenience and the efficiency of video editing.* ; > - t j : % 

SUMMARY OF T|4e INVENTION : " r 1 V ^ ^ - * - / ' , T - ' ; , - 

[0008] According to the invention, a video editing system comprises a computer system provided with a mass storage 
55 and further provided or connected with one or more video source such as an optical disc player, video cassette recorder 
(VCR) and/or camera The.computer system operates under the control of standard operating software and video edit- 
ing software i stored in the nriass, storage. ; ' . . ' ' r 1 ' : v 1 
[0009] In preparation for a subsequent editing process, one or more* source videos are first collected and stored as 
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video source material in the mass storage. One or more of the stored source videos is (or are each) checked to gener- 
ate scene records which define respective video segments constituting the source video(s). Scene records are also 
generated for the other source videos. Thereafter, the video segments and the other source videos are called "scenes" 
and dealt with by operating respective scene records. 

5 [0010] The display screen of the system has at least one scene display area. The area is comprised of an array of 
windows for each displaying a frame representative of each of available scenes constituting the source videos (the 
frame is hereinafter; referred to as "a scene index"), v Tt*e scenes are displayed in the t area even if they are selected as 
clipsfbr use in the video program. , ^ , . . yi . it , -l- r .. •, ■ ; , • ] 

[0011]; In apreferred erjJbodiment the recqrds are maintained as^ Each record has at least the field of 

10 an ID and the length-in-number. Each record preferably contains begin and end frame numbers, a selection flag, a 
frame pointer for scene scrolling, a component scene IDs for grouping capability, a selected order for clip sorting in 
selected order, a clamp flag for scene clamping, and a transitional effect. , 
[0012] Simulation is conducted through manipulations of scene and clip indexes, e.g., segmentation/grouping, clip- 
ping, ordering, etc. Infprmatipn on a series of such manipulations is accumulated in the scene table. Finally, a dip list is 

i5 obtained. Recording to the Qlip Hst^ . J ,7 . v v 

[0013] According to the prinpiples of the invention, one or more frame of a user-specrried scene or clip is displayed. 
Any frame of the scene is accessible by controlling forward and backward button and a scrolling bar. The value of a 
frame pointer is stored for each index, enabling a resume of viewing. v 

[0014] Specifying desired scenes or clips, the user can grpiip^the desired scenes or dips. In grouping, a scene record' 
20 is added to the scene table, IQs of grouped scenes p ; r { cjips. We v: stor#d in a component f ield of the ad[ded record. % 
index for^the group is added to an index set. The indexes for^ the index set. The 

grouping is achieved either in order of time if the specified scenes or clips have been derived a single source video or 
in a specified order. Grouped scenes or clips are further grouped. :.. > ? - . - ; 

[001 5] In an embodiment with two display areas for ^scenes and clips, once scenes are grouped, the grouped scene 
25 becomes a dip automatically. That is,, the. grpup'^.^m^/jdi^^ie^r f cdm the r scerie 'display area, instead appear in a 
clip display area. - t .... . . , ' . . ./ " u ' /. . . . 

[0016] Also, in an embodiment with scene and clip display^ specifying function js provided. If the 

user specifies desired ones of the indexes, the desired ones kre become in a specified state and the remaining indexes 
become in a nonspecified state, rf the user enters a pred&ermihed input at this point of time, the specif ied state and the 
30 nonspecified state areureyensed. , , .;.'-> Z,.^ . ZZ\. ... " t Z"., , 7 

[001 7] Selection and unselection functions cause a sc§ne ^d a cHp to be chang ed to a clip and a scene, respectively. 
This functions can b^, applied to the same scene or dip at any times. Each time one of the two functions, predetermined 
fields ^selected order fields in an illustrative embodiment) of the. record are so updated that the selected order fields 
retajn values indicative of the order of selection of : respective ^en clips. By doing this, the clips can be sorted in 
35 the^seiected. ord^r. .\ . "] t '.V :v ./... VV'- .-v ']... . ] -Z . , '. ' . .. 

[W18] The clips can b^ sorted jn order 

[001 9] Each time a segmentation or a grouping is performed, predetermined fields (original order fields in an illustra- 
tive embodiment) of the records which eachi contain the.order .of. the scene? are so updated that the fields of the records 
reflect the order of current scene indexes. If the while specifying a desired 

40 scene index, then the specified scene index islVeslbr^i Jp^' r;e^lye % positiOT with respect to a scene index which the ; : 
specified scene index was adjoining at a time of occurrence Qf a pr^etermined event. In a preferred embodiment, the 
event is a later one of a last segmenting and aJast groupin^^^iss user can select whether the specified scene index 
should be restored to a next-based relative position pr a back^ased relative position. ' 

[0020] rf The video ..editing .system is ifur^erproyided, with a function for causing a start time, in the edited video, of a 
45 user-specified one of the yjdeo segments (derived from a single source video) to be the same as that in the single 
source vid^o. (hereinafter referred to as "clamping the user-^ecif ied yidep segment to the single source video"). For 
this purpose, the user can issue a command to clamp a specified video, causing a flag to be set in a predetermined field 
of a record associated with the specified video. Then, in a wmpiling process, a. scene just preceding the specified video 
is so trimmed that an end frame number of the preceding scene in fejng compiled is smaller by one tlian a 

so value of a begin frame field of the record associated with the specified videa ^ 

[0021] Also, the user can set one of predetermined transitional video effects to an effect-containing field of a record 
associated with a user-specified index. Then, an effect identified by the effect-containing field Lis applied to the video t 
segment associated with the user-specified index. 

55 BRIEF DESCRIPTION OF THE PRATING" '. ' ! . ] " / * /. , X If^^Z V,./ , ' '/ ' ' f 

[0022] Further objects and advantages of the present invention will be apparent from the following description of the 
preferred embodiments of. the invention as illustrated in the accor^ '/ ' ^ 
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' FIG 1 is ai schematic block : diagram sHowin video editing system embodying the principles 

; of Re invention; : ; : ^' ; * :nr ^' ^r;/** 01 ! ; " f1 "^ K Lv;r ' '"' : ' yt }: ' - • 

FIG. 2 is a diagrarn iilu^r^hg to ' ' r 7 

FIG. 3 is a schematic diagram illustrating exerr^ij^y'bpe'^ cbntroller 11 6 (or a not-shown 

/CPU) "of the video editing sySterh ibi^^ video 1 editing program 20 irv accbrdance with afirst 

" illustrative ernb&irtiem -xJ.-^ v ox--v -:\ ^s.* ^:* 5 .cr. v • 

FIG^ 4 shovite^e>^^ te/r— : ;*•...-, ^ ; : ^} 

/ FlG.Sjsad^ - ^ : : '^ ; ^ 

FIG.' 6 isadiagrkrh - 
FIG^isadiagr^ eg.VCA has been segmented; 

FIG! 8 is a diagram sticking ah exemplary OTartSemerrt: of the sdehe indexes displayed in the 'scene -display area 1 
43 after the automatic logical segmentation of the scene CA; .; iv w ; • y ♦ >. 

FIG. 9 is a diagram showing the structure of a part of the scene table 520 which part follows the ORG ORDER field 
522; • • ■■■■ 

: F;Cs. 1GA«rid 10B, when CGi^itJ, constitute a flo^vchsrl shewing an exemplary operator: cf a browsing j^d seg- 
mentation subrbutine ^00 accdrdin^ to the p *vs- " : - 1 ; • : r? //" 
FIG? 11 is a diagram shc^hg two exemplary ways of frame display 'in the' scene browsing function; 
^ FIGi 12 is a flowchart showing ah 'exemplary operation of a grouping subroutine '230 according to the priridplesof 
the invention; ^. : , . ::h ' : s ~ —'" •"--.--u -uv 
PlG; 13'& a^gi^lllu^ating how 'scene's are groined ^accordance with the principles of the invention; ^ 
FIG. 14 is a diagram illustrating afi ; example 61 ^di^ir^^^bu^ed-Wenes in accbrdance with the prindples of the 

A ! FIGs. 1 5 and 1 6 are i f IcW charts showing exern^lary o^ an uhselectibn subrouti ne 300 and a isel ectton 

subroutine 310 according tb the ^ : i: - , v >r ■ 

FIG. 17 is a flowchart showing an exemplary operation of a sort subroutine 260 according to the principles of the' 
invention; ^ ' - :; ' ?: '' " !/ ' ■ " ■ • ;V : 

1 ^l<j isjs a flowchart shewrib an exemplary operation c^|a relative 7 posi^ 250 according 

\o the princi^les of thb ihyentidni; ; ' .^/ J * x r . ' ' r ' ' " r ' y ' ' ■ 

Fid. 19 is a diagram illustrating How the relative position rekora^ accbrdance with the iriven- 

\\..;tbh;'; ; ; ''-v • ; "/".".'r f vv tr " ■ " r *--^'-.-;' % • : ' 

FIG. ?6 is S diagram showing ari example^ ^of a video prp^r&rn ^sembling prbcess attended with the clamping of a ; 
^. , cljp in\ac<^rdan^'with/Me prihdples-bf'the invienticfn; lij ^. ^-v"- s -\ r v \ ^ t , . ■■ -> 

5 FIG. 21 is a flowchart showing an exemplary operation of S^dSmp setting subroutine according to the prindples of 
; . the inyehtibh; ' " ^ ' / r ; : "\ ; ;' 1 ; .'[ : ""^' " " " r "' " ? '**" s ' : : 5 ' :?L : - 

\ FIG. 22 a flowchart showing an exemplary operation of a transftibnal effect setting subroutine according to the 

principles 6fthe1r^ention^^^^ j ^^^^^^^^ * " .• ° ' • ' l ' * v . \Z ? ^' * . * : ' w * A " r ''••'"'- r -^' 

' J FIG. 23 iW a ^fjbwchart sho^rtg an exehriplary c^r^tioH^bf 'a ^ videb prdgram compiler subroutihe*according to the 
"principles of the ihyerrtion; ' ^ ^ • ^.vjv^^u:^ ^.v v:- - -^r --- - ..^ ^- ^ - / -:-\' : r 
FIG] 24 is a dia^farn illustrating how the ^ecifie^^ = 
. FIGs. 25 and 26 are flowcharts showing exerrplary operations of a selection subroutine 320 and a unselectibn sub- 
routine 330 according lb the principles of the ' j ;- 1 / " ^ 
_ Ng." 27 is ai diaqrarjri showing ah examj5|e of a scene 1 selection in Which a selection command i§ executed after 
^ reversing ^e specif ie^ r * ' : ^ v 
\] FIG. 28 is a diagr^ showirig an example of *dn isdit display screen of a' second illustrative embbdiment of the inveh-' 

^" tiqn.^ ; ;. ^ . " ';V " \ 'l^A^v^ Vj : v /". ' 

[0023] Throughput the Brawng, the same elements when 1 shown in more than one figure are designated by the'same 
reference numerals. \ 1 , \ ; ' '" ! ' ' v ' ; v 'p- ; ^ ■■ ■■' ' ; r :; - : "> • rt 

DETAILED DESCRIPTION OF THE PRE FE R RED^MBOD I ME NTS " ' - ; ' " ■ ^ > ^. ! . £ 

[0024] FIG. 1 is i a scjienniatic Bock diagrairh showing ah arranjgerhent of a digrtal video editing system 1 00' embodying 
the prindples of the invention. In FIG. 1, the video editing system is a cbmputer^based system \wh1ch comprises a 
bontrpller^lbO, including a central prqee^ing | unit ^ (hbt ishbwn), kread oniy mehxiry (not shoWnj and a rahdorh- access 
memory, (not shown) which are i interconnect 1 ; a niass storage device 112; a keyboard 1 16 

and a mouse 118 cohhected^thrbugh input interfec^ and a display 122 connected through a video interface 

120. The system 100 may further comprise a jc^d^ei[ker 124/in which case the element 120 will comprise a video 
and audio irrterfaces. The video editing syfeterri 100 ihcludes"bri'e or more video source device such as a video camera 
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lautomatic, an optical.disc player 134, a video cassette recorder (YCR) 136, etc, whic^i is (of are) connected to the sys- 
tem bus 111 through respective video source interlaces 130. The system 100 further includes a video (and audio) 
decoder 1 38 for converting a coded video and audio data stream jnto a digital video stream (arid a digital audio stream) 
which is (or are) supplied to ^ ;f . ' ,/ , ' 

5 [0025] The video(/audip) decoder 1 38, m^y be any suitable! one such as : a ^sterrtang MPEG decoder The .video, (and 
audio) output Ifs 120 preferably includes a video (and audio) digital/analog i converter (pot shown) and an NTSC 
(National Television Standard Committee) or PAL (Phase Alternation l?y Line) encoder (not shown) for example! 
[0026] FIG. 2 is a diagram illustrating contents.of ? the mass storage device Xy2.^e mass storage, device 1 1 2 at least 
stores an operating system 10, a video ediflng progra of source videos) to be 

w edited, an edited video program 3 edited J^^ prograrn-20, and various data 5 whjch are created and 

used by the video editing program 20 in the course of an editing process. The operating System 10. may be any suitable 
standard or tailored operating system. . _ -:r u ' ■< <- , >V-. 

Embodiment I \ ^, 

[0027] FIG. 3 is a schematic diagram illustrating exemplary operations of. the user jand the controller 1 1 0' or the CPU 
(not shown) of the video editing system 100 under the control of the video-editing program 20 in accordance with a first 
illustrative embodiment of the invention. In FIG. 3, bold-line boxes denote operations by the user, tine-line boxes denote 
data, and double-line boxes denote displayed contents. 

20 [0028] The user first starts the vidTOTeditingprpgrarn^Q in step, 30, Then, the .CPU (or ( the controller: 1 00) delays an 
edit display screen AQ: FIG. 4 shows an exanple crf f^ 4, the edit screen 40 includes 

camera and file buttons 41 and 42 for taking in a source video from a camera 132 and files stored in a storage media 
(1 34-;or 1:36), respectively.; The edit screen 40 f urttier includes, a scene djsplay area 43 comprising an, array of small 
frame windows in each of which a frame is displayed, and [ sprolUiip Jand scroll-down buttons 44 and 45 for scrolling the 

25 displayed frameJines up and down, respectively. ... , :z .... ...... .... . r .. ./ / J 

[0029] The user first takes in at least one source videos 1 by using the camera 41 and file 42 buttons in step 31. The 
CPU resppnsively takes in the source videos 1 in a predetermined directory or folder of,the mass storage 112 asf shown 
in FIG. 5 in step 21. Then, the CPU creates a scene table 520 (shown in FIG. 6) and enters records of the taken-in 
source videos .1 in, the scene table 520 in^^ f ^o S F^^I^. > the. CPU stores a file containing each of the first frames of 

30 the source videos 1 in a predetermined directory in the mass storage 1 12 and displays the first frames in the scene dis- 
play area- 43.- It is noted that the squrceyideos 1 may comprise, for example, one content video and a plurality of com- 
mercial videos, or may comprises, for example, a plurality of content videos and a plurality of commercial videos. 
[0030] FIG. 5 is a diagram showing how various data are stored in therriass storacje 112, wherein directories are 
shown by underlining respective directory names. A directory is created in the name of a desired video program, say, 

35 "ProgramX" j(in this example) ip the mass storage 1 1 2, ; . T^adatadirectory "ProgramX" comprises, the directories "Vid- 
eos," "SceneData" and "Scenelndexes" for example, the directory Videos contains the source videos (CA, CB, CC, CD 
in thjs examp|e) ,1 and is to contain an edited video pi;p9ram .(PrcxjramX in this example) 3 whien the editing process has 
completed. The directory Scenebata contains the scene table as detailed below. The directory $cenielndexes contains 
scene indexes (detailed below) rarresponding tp the r sp^ e.g M/ CA, CB, CC, CD. Jhe scene indexes are 

40 pr^erably named identical to corresponding spurceyjdeps^ 

[0031 ] FIG. 6 is a diagram showing an example of a scene.table just after the creation thereof; The scene fable 520 
maintains scene.records of all the pieces of video data.pr thesicen^ ayailabje for assernbling an edited video program: 
i.e., the taken-in source videos (CA, CB, CC, CD in this example) i and the video segments obtained from segmenta- 
tion of any source videos ,as detailed later. A scene record.j^ freime and end frame 

45 fields which, if the scene is a segment of any source video, contain the begin frame number and the end frame number 
of the segment in the original source video; a length-in-frame field which contains the number of frames constituting the 
scene; a length-in-time field which contains the play time, at the pormal play speed, of the scene in the form of M M S"" 
where M and S denotes minutes and seconds of the time, respectively; a select field which contains a flag indicative of 
whether the scene has been selected for assembling a edited video program, e.g., "Y" (for "yes") or "NT (for "no"); iand 

so an original order (ORG ORDER) field 522 which contains the .display order of the scene index displayed just after an 
automatic segmentation which order is used in a relative positive position restoration function detailed later. 
[0032] Since FIG. 6 shows a scene table 520 just afte^the creation thereof and accordingly any of the source videos 
has not experienced a segmentation or an ordering, the scene records have no value in the beg^ and end frame fields, 
and the original order fieJd, 522, Specifically, the source, video the framelD, 

55 length (frames), and length (time) frames, respectiveiy; v the source video CB has values CB. 2700, 1.30" and Y in the 
respective frames; $nd so on., The values pf^the select fields are ^i y's, because i,n default of selection, the illustrative 
embodiment deals with the scenes .as selected for Vse in the object video program* \- ^ t y 

[0033] , Referring to FIG. 3, if there are any of the source yideps i fe the user allies 4n auto- 
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matic logical segmentation to suph sourc> tid^ln ^ a desired source video with 

a pointing device such as the Ifwuse 1 1 8 and click^ oh either'a biittoh 46 for logical segmentation by scene changes or 
a buttqn 47 for logical Segmentation by a ^ ciert^fi 'tirrie interval or frame ;humt^i;-Whi'dh may be preset by the us6h In 
response to; a clicjdhg on the the CiPU I^ically s^jfnents the ispecif ied^sburce video in a respective 

s manner. That is; the CPU adds a ^ehe; record to ; tt1e isicieHe tiller 520 for each of the 1 obtained video segments or * 
obtained scenes identified by scene changes such as changes 1 In trte brightness and/or the color toiie or by a time or 
frame interval through the scanning bf th£ spe^i^ Murce the CPU deletes the scene 

recbrd of the segmented source vldib from the ^feneteb ?s * u ?x'">*' ■ : ; ±- v ^; 

[0034] FIG. 7 shows ah exarripte erf the'sc<^e table 520 afterlhe automatic logical segmentation- of a source video; I- 

io e.g.; CA. As seen frbiri the table of Fid. i 7» "'©^e' re6^' : CA v 'h» ; b^ri deleted, but six hew records are insteiad 
added in the narriesi CA;1 thresh C&fe in this way rthei Series obtained from a segmentation of a Source video 'are '2 
each nam^ by simply appending^ delirriiter (e.g./Vlhthisex^ number to the scene ID of the source T 

video. Since the scenes 6a!1 through CA.6 have beeri derived from a single scene CA t the scene records CA.1 through 
CA.6 have also respective values in the begin and end frame fields. It is noted that the begin and end frame fields for ^ 

is the raw videos 'CB! CC and Cb are also f illfed for the sake of converiiericie. 1 ' :Xv ' : ' ; = ; fi ■ r - ^ ^ r 
[0035] On updating the scene table 520, the CPU deletes the scene index file CA from the Scenelridexes directory, 
and adds six scene index files Which contkih^ for examplei, the first frames of the new scenes CA.1 through CA.6 to the 
scehetable 520^ then, the CPU displays; jrfthe scene display areia 43, the frames of scene indexes (43-2 of FIG. 3) 
contained jn the scene index files (CA.1 through CA.6, CB; CC and CD) in the Scenelndexes directory. In this case, the 

20 scene indexes? are preferably displayed in brdesr s of thfe ? se^mehteid scenes and the raw scenes ais shown in FIG. 8.= For^ 
this reason, the original ordeir fields 522 of tl^sk^dVtiraids^CA:^ thrbugh GA.6, CB, CC and CD contain the values 1 
through 9, respectively. "V." •- ' '"'"'' v - : ' r " - v - ■' V; •'■■*' ?,: ; * : • ■ ** *■ * ; '■ - 

[0036] jt.^puid be noted that if th^ scenes and respi^ive&c^ are stored In this same nannies in different 

directories as described above, the scenfe indexes ckn be managed in the above described manner. Otherwise, eadn > 

25 record in the scene table 520 will neied an additional field for containing the name of scene index file for the correspond- 
ing scene, ft is also rioted that the user is permitted I tb selebt la^frarrie in a scene for the scene index, in which case 
the selected fj^rrie is stored in fee scene ind^ - ; - •■■ ; ?rl>*f.<-.i ; : f ;> i 

[0037] Referring to FIG. 3, the user selects desiried scenes out of the available sceihes by s^cifyihg desired onesrof ' 
the scene indexes 43-2 displayed in the scene display area 43, where the selected scenes are thereafter referred to as" 

30 "clips." and arranges the order of the selected scenes or clips in;step 34: Resp fills the select ^and T 

order 522 fields of the scene records in the scene t^le 520 as detailed later in step 24 and displays the representative 
frames or indexes of the dips and the c^her scenes sUdi thai the dip indexes and the scene indexes are in normal and 
reduced contrast, respectively, and I the dip indexes are sbri^ : v > ^ 

[003£] If the user finally issues 'ah'' edited^ 36; then the CPfcj assembles an " 

35 ec^i^.vidjeo "program, based bn the' records Of the ct^k in the v scene feble 520 in step 26. ; * " ^ > 

[0039] ;Tfie : video, eating jsysterri [1jp6 adcoi^irtg to the first ijlUsfritiWe^ the invention is provided with the 

capabilities of:. , ~\ \l. ."',./.*,.■' \\ . ' " " - Vi; "' "■ ' ,r ^ " :i *** " 1 • : ' ; 
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a) scecie browsing .With hext^'and back itehs anchor ; a scroll bafp''' i:/v; ^ '* B ' 1 '' ■'>) 

m b)* recursive scene s<e^e|1tation avaiiabie wrtfi tfie 'bit^h|lunSBn; <: '"' f ■ ^ 

cj" recursiye'scehe grouping^' " ' ' '''^.^ '''f "' ?i,v "-' - : 1 - ' ' - : 

]> '.cO^sc^nei. clipping ba§ed ph'Wectibh by d^Uft;';^' ' :{ '^ ' ; ' Vv : '~ ^ > ; ^ -t 

e) clip sorting; '.. ' . \' / ' . " ' ; ' ^y^X-^^V^'J' *7? .*! ' ' ' ' ; ' ' : ' /; • • ' ''-' * :/ • - : ' v ' • 

f) relative positon><^orati^6f a 'specified sjp^n'gV'.' ^ ;J 4 ^ ! ' c , ' e: r ? ; 
45 g) clamping' a scene to its original pia/ timer and'" ^ '^^'l : '[ *''' r " ' '•• v - - * ; 

h) scene transition pjrbcessin^. J/"! .'^'' ^^^^^ V'^ ^ o ■ . >:;. \->:^; 

[0040]. The^e features of the video editing system '100 will be described referring to FIG. 9. - 1 

so Browsing and Segmentation, ' . ^ ? ! ■ T ^ - ! ^ ¥ /' : ^ . ; ' "'' • 1 c 

[0041] A frame pointer if iejd 524 of the 4cen4tabl^ 520' of FIG: 9 contains a pointer for use in the scene brbwsing fuhc- 
tion that indicates a frame to be displayed. When a new scene reScord is crisatedl the value of the frame pointier field 524 
is^set equal to the value.of the b^gin frame field of the same record if the begin frame field has a value and is set tb^1 - 
55 otherwise. .. ' \[ 'j ' . ; . ' 3A : * 1 - ■? . >-.'v 

[0042] FIGs. 10A and 10B;when cbmbirieb/cdnstitCite e flcw an exemplary operation of a browsing ahd 

segmentation subroutine 200 according to the principles of the invention; If the user performs a predetermined opera- 
tion such as a clicking on a scene browser icon, a selection of an item "Browse Scene" from the menu, etc. while spec- 
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ifying a desired one of, the sc^oe ;ind^es : ,displayeHd jn-'I^^^^P^^I^^I?? 43 ■ * hen ^ rpgin routine pf tfie video 
editing program 20 galls the^brpwsjng and.^egm CP,U>^ire 
tine 200 with step 202, where the QPU calculaftes andsets the jnitik ^lu^gf ^ scrolling switch 48* of a scroll bar49 from 
the/values of the begin and ^n^iframe fields and Ihe^f rarr»e : ppfnter field 5^4 of the specified, scene record in step 202. 

5 The calculation in this cas&isa well-foiown^rule^f-tiue is a ncrt-shpwn scroll bar 94 rou- 

tine whjchioutputs a relative position information on the of the user with 

a capability otsettingthe initial position oithe switch ^a^ a suitable form. 

[0043] In step 204, the CPU displays one or more frame including the frame pointed by the frame pointer,, i.e., the 
value of the frame pointer field 524 oithe scene r^rt of Jhe sp^ifie^ scene in a predetermined manner. FIG. 1 1 is a 

to diagram showing two exemplary ways of frame^.djsglay in ^^sc^ne browning iincfion.; As £hown in FIG. 11, | plurality 
of frames including the frame identified by the fraipe poirter 524^may be displayed in a display area or view window 61 
created pyer the specified scene index 60 >: (amultiple frame display), or the single frame identified by the frame pointer 
524 may be displayed in a vi^ window -61 ■ A: next and bacH io?ns 63 .^rxJ 64 ; are preferably displayed n^r ftte view 
window^, eg,; below it ,- c ; , ; . ; v ^ ; : ,r. r - - ,■ c ,, ■ . 

15 [0044] If the user clicks on either the next 64 or bacK.!63 icon in step 206, then the CPU increments the. value obtained 
from the pointer f teld ; 524 in case of the next icon 64 and decrements the value otherwise in step 2ti8. The CPU rnakes 
e test, in step 209, tosee if thevalue or the frame number is in the range from the begin frame number to the end franie 
number of the seenein question. If so. then the CPU^tpres the value in the pointer field 524 in step 210 and goes back 
to step. £04 to display an adjoining frame, p^eiwise, the CPU returns to decision step 206. If either the next oKbac^c 

20 icon has not been operated An step 206, the CPU proceed^ tp decision step 21 1 , where the CPU makes a test to see if 
the user-operates the scrolling switch 48. rf so. thenip ptep 21^e 

the relative position data of the scrolling switch 48 on the scroll bar 49 and the values of the begin and end frame fields 
of the sc§ne table 52Q and proceeds to the abpye^d escribed st^p ; 21 Q to display f rame(s) v near a desired position. ; 
[0045] It the test result is NO in step ?U, then me^^U.^kps areither test in step 214 to' see if the user issueSa 
25 segmentation commando If so. the CPU proceeds to ^eg £22 of Fl<3- 10 Bto perform a segmentation as described later' 
Otherwise, the CPU makes a test in step ?18to ^eie. Jf^tbe.. use* desires "to iermiriate the. browsing mode, ffnbt. then the 
CPU returns to step 206. If the test result is Yes in step 218, then the CRpj^rns 7 tp ^.ma;in routine of the ? .vidM;'^it^ 
ing .program 20 after ascertaining in step 2 1 9> that £ predetermined queue (used in segmentation as described beldw) 

is empty;, / : , ••• f,:-- r \; ■> .... ■« i^KY^v* x £ v • -. .., 

30 [00461 Tlie; user Js preferably perm^ "* . " \ 

[004?] f .-.R is noted that the yalue of the frame ppin^ r^ainied after the termination pf a brbwsing mode for 

a scene. T^is ensures the resurr^ / 
[0048] The user is permitted to segment a scene at a!^ browsing the scene as described ' 

ir>connection with steps 214 If the user issues a segme^ a predetermined manner in step 214, the 

35 CPU proceeds to step 222 of FIG; lOB. Jn step 2^! the !pPU displays a dialog box to ask the user whether the current 
frame; should be made the end frame .of the former s^ment or the b^in fram^ of the latter segment and pronipt the 
user to select either oif the former and the latter, ft the user select onie of the two '(he or she may changfc hifc or her mind 
and desire to quit the segmentation), then, in step 224, the CPU adds the current frame number as it is to a predeter- 
mined (end frame) queue if the user selects the former (La, .desires Jo maKe the,current frame the end frame of the 
40 former segment), and adds the current frame number mjnu^ 

ter. In step 226, the CPU asks the user whether he or she desires to segment the scene further. If so, the CPU returns 
to step 206 of FIG. 10A to continue the browsing for further segmentation; thereafter operates as described above; and 
returns to step 222 from step 214 of FIG. 10A or proceeds to step 227 from step 219 of FIG. lb A. if the answer is NO 
in step 226 or if the queue is not empty in step 219, then the CPU proceeds to step 227, where the CPU closes the 
45 dialog box and performs logical segmentation of the scene according to the qpntents pf thei predetermined queue. 
[0049] Specifically, the CPU adds to the scene table 520 scene records having the frame numbers contained the 
queue as respective end frame numbers (in this example); deletes the scene record and the scene index file of the seg- 
mented scene from the scene table 520 and the Scenelnd[exes drectory. respectively; and adds scene index files of the 
new scenes to the Scenelndexes directory Again, the new scenes obtained from the segmentation of the scene are 
so each named by simply appending a delimiter (e.g., "." in this example) and an additional ID part (e.g., a serial number 
in this case) to the scene ID of the scene. The delimiter may be any suitable symbol. The additional ID part may be any 
suitable expression including a sequential notation such as a serial number, an alphabet etp. For example, if the scene 
CA-2; is segmented into three, then the new .scenes -ajre^A.2. | ^bugh'OA^Va v In this wky t the invention ensures recur- ; - 
sive segmentations and facilitates .undo operatibn., ... ... ..... t ; v , r „ . . . 

55 [0050] After step 227. the CPU clears the queue in step 228. Finally, the CPU updates the ORG ORDER fields 522 
of the scene, table 520 for the sake, of a relative .position restoration function (detailed below) instep 229, and,r;e|ur^ to - f 
the main rqirtne of the yjdep-e^iting program , r ".>,--' 
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Grouping Scenes ''"'*"' 

[0051 ] It is assumed that the video editing system 1 00 is provided with a flexible scene specifying function Which can 
specifying a plurality of scenes including successive ones and separated ones to pass them Jo other function. The user 

5 is permrtted to group the^ 

[0052] In grouping the Since Jhe scenes are generally 
classified. into ^two jypes---.-ani order-sensiti ye type and ^ to be ^ considered in; 

grouping. A group of scenes of the order-sehsrtive t^e We scenes obtained Byfa $egmenta^tion of a scene, i.e>;, £cehei ; 
the names of which each include at least one delimiter in thefcene-n^ Scenes of the independent type 

10 are raw videos or scenes whic^.have expenenc^ n^ rio^delirriiter in respective 

names). : . ... .. Z : .,. . 'ZZ ; 2.ZZ- Z Z'"Z'yZ- ".,^."Z'V. \' ;\ : ::; r . '2 '* "] v ' 'Z ' ' \\ Z Z' : ' : "'~'' " ' t] 

[0053] . ^so, the, user is permitted ; to ^ecifyone of ordering £cfe^ specified sequence 

except when the spewed scenes are of the independerft type. H the ^eqf ied scenes kre of the independent t^pe, the 
only order) ng scherne the user can specify is the specified sequence.' [ / ° ' ' J ' J ; ' 

15 [0054] It is noted that the above-mentioned scene specifying function reports not only the specified scene IDs but also 
the specif ied orders of the IDs. ... , <v ^ '2 ' .-Z - - Z'Z'\ • • "... * • . • Z.* Z' . " " Z 

[0055] FIG. 1 2 is a flowchart showing ah exemplary pperationof agrouping subroutine 230 according to the principles 
of the invention, H the. user issues ,a grouping' conrj.^nd..^h desired scenes specified, the CPU enters the? grouping 
subroutine 230. In step 232 r; the CPU makes s a te^t to > $ee ^ )f : the^er^pecified any drderin$ scheme. If nipt; the' CPU 

20 keepsthe relative positions of the specHi^ sre^ in ^tep 234 (Case 1). If the user 

has specified any ordering scheme in step 232 arid if the scheme is the specrf ied sequence scheme in step 236, the 
CPU sorts the scenes in the. specif ied Qrder while keeping the feeler qiscenes specified by a drag 'of the mouse 1 18 as 
they are in step 238 (Case 2). If the scheme is nohhe specif ied sequence (but the tirhe sequence scheme) in step 236, 
then, the CPU. makes a test in step 240 to see rf all of Jhe specif ied scenes are of the order-sensitive type. If so, the CPU 

25 sorts the scenes in order of time in step 242 (Case 3) bfo^wj^Tl^e CPU shorts only ih e order-sensrti ve scenes in order 
of time while. keeping the order of the rest in step .244 (Case 4). / • , '\ZZ * " " ; v 

[0056] After any of steps 234. 238, 242 and 244, fhe'CPU proceeds to step 246, ^where a f s<^nefex>oixl' of the seethe 
into which the specified scenes are grouped is added to the scene table 520. In this case, a COMPONENTS field 526 
of the scene table 520 contains scene IDs of the specified scenes in an order determined in the above-described rhan- 

30 ner, Jn step 247, the QPU updates the pRG,ORDER field§ 5?2 of the scene table 520 as detailed later. Then, in step 
248* the CPU deletes, .from the directory Scenelnde^, scenes except the scene 
index of the scene which appears first in the hew^'en^^ar^.displ^ the sc^ne indexes In^^dir^^iV'^eneli^exesr' 
[0057] It is noted that the begin and encJ'.frame.'f iel^ ^a.grqi^ld scenft have; no' valued because th^se Values can 
not be determined (except for a ^pecialcase as detailed j^t^rXW^ c!(ip list'" whidh defines ah edited video program isf 

35 completed.-, . ..^ . . r / * Z'ZZ Z- ^ZZZZZ'^ZZZZ^ "'. ZZ "2. "Z ' \Z "* Z. Ar ] 

[0058] i, FJG. 13 is a'diagrara illustrating hcwWenes ^ In' 
FIG^{1 3, .CURRENT reb&ted 
numerals each indicate the order of specrf ication of "the 1^i^e..\j^^^[Me same column, iand a humeral with i an bverline 
extending across a plurality of scene jndex<es indicates Wat trie sperie indexes along the overtine are specified in trie 

40 order spepifie^ by toe numeral , \^\Z i ^-Z i ,--Z i ZZ--Z' • ZZZZZ.ZZ,. \Z'Z i " f ^ •[ ^ 

[0059] Specifically, the row SPE. | jndi^tesrthat ^ CA.2. CA.1 and CA.3 are jpeeffied^en 

bloc by a drag operation, The three following rows labeled CASEVl (1)^2(1) and 4 show ttie states dfter grdupihg oper- 
ations executed for respective. cases (described above) under '0e^ecific^&pn : c6MHioh SPE.1 / Likewise, the row SPE. 
2 indicates that OA. 5, CA.2 and CA.I.are ^eclri^ppejbx orjjain^tliis order The JtKree following rows CASEs lf£), 2(2) 

45 and 3 show the states after grouping operations executed for respective cases under the specrf ication condition SPE! 2. 
[0060] It is noted ^at though.each grouped scene in length to the nurnber of coristituerjt 

scenes in FIG., 13, the scene iride^ of ^e H fjrstxon^^ scene in the 

scene display area 43. r>Z\ZZ?,Z',"ZZ- ZZ^ZZ . , Z ^ ' 

[0061] It should be noted that the aboveKJespribed ..g^pj.qg^f^nc^ph'is recursive! that is, the. grouping command can , 

so be applied to a scene ^group all f or, part. of which ar^ i gripjuped^ scenes. In grouping scenes including grouped scerie(s)/ 
grouped scene(s) is (or are) dealt wrth as indepehdert scen^ reason, only the above-mentioned first and. sec-:' 

qnd cases are possible in a., recursive ^o^^^ Z[ ^J ,Z Z^ ^ - 1 T Z\ *[ ' . . ! 

[0062] FIG. 1 4 is a diagram illustrating ah example of grouping of grouped scenes in accordance with the principles 
of the invention. In FIG. 14, encircled numerals denote specified scenes to be grouped. In step 1. scenes A and C are 

55 grouped into a scene A • C. In step 2, scenes B and F are grouped into a scene B * F. And, in step 3, the grouped scenes 
A • C and B • F are again grouped into a scene (A • C) • (B • F). It is also noted that grouped scenes (A • C) * (B • and 
A • C • B • Ft ^re identical to each other and, accordingly provide ^ identical videos. However, it is preferable to store the 
component scenes in the components field 5^6 of the scene tebie 520 in a format like the former expression^ in order to 
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facilitate a so-called undo operation. 



Scene Clipping based on selection by defaglt , ..... , v , , .... 

5 [00631, £s shown. \r\ JFKjjQX th® Reject, fields of the%ci3h4 table are ihHiiialiy filled with Ys far/Yes's).' This means 
that all of the scenes are initially in the ^a% Accordingly, in the 

vtd^edi^pg system 100, the user selected^ ih an unselected state. FIGs. 

15 $nd 16 are flowcharts shoving exenripiary (^eratiqre of an unselectipn subroutine 300 ( and a selection subroutine 
310 aca5rd;ng,to ^e principles of the iiWe^pnl ^ ^ ^ 1 ^ / / : ; 

io [0064] If the user specif ies unnecessary scene(sj whic state by mdans of the above mentioned 

scene specifying f unction and clicks on a LJNSeLeCT button (icoh) 50 on thei display Screen 40, ihen the linieleetion 
subroutine 300 is invoked. In step 302, a value "N," which means an unselected state, is written in each of the select 
fiejd(s) of the scene teble 520 associated with the specified ^cehe(s). Then, after updating the SELECTED ORDER 
fields 528 of the scene tabie 520 (as detailed later) in step 304, the CPU reduces in contrast or shades the scene 

is index(es) of the unselected scene(s) displayed in the scene display area 43 so that the user can easily di^rimihate 
between selected scenes and unselected scenes! in step 306. ^ ' v - y 

[0065] Similarly, the user can select one or more unselected scene again by specifying them with the scene specifying 
fqnctipn and clicking on a SELECT button 51 on the display screen 40. In this case, the selection subroutine 3 10 of FIG. 

16 is invoked. In step 312, a value "Y," which means Ah selected state, is written in each of the select field(s) of the 
20 scene table 520 associated with the specified scenes)! Tr^ ORDERfields 528 of the 

scene table 520 (as detailed later) in step 314/the CPU displays the scene^m^ selected scehe(s) irv the 

sce^e display area 43 in the ri^ - " 1 ^ * " 

[0066] In this way, the video editing system 100 pet-mite the us^f to ^sily bhahge between selected and unselected 
states of eaph scene. " - .... '-'-V' ■ - ■ V " • ■ •• 

25 [0067] ft is noted, that this specific embcidiment js using; two buttons SELECT and UNSELECT for scene selection, 
however the scene selection may be realized with a sih^l^buttorv Iri this case, irisfeiid of writing a predeWmihed value u 
Y or NJn each select field, the value of each select field, read but inverted; arid then restored to the select field?' 
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Clip Sorting 



[0068] Once all. scenes that the user thinks to be neceissairy are selected/ the order of the selected scenes or clips 
will be arranged. For this purpose, the editing [ system 100 is provide with a sort function. The soft function acts only 
on the selected scenes. That is, after the sort command is ^ecut^; the Elected sorted iscenes are disposed from the 
beginning of the scene display area 43, and the unselected scenes are disposed after the sorted scenes. ■ 

35 [0069] FIG! 1 7 is a flowchart shbwihg an exemplary bperafion bf ai sort subroutine 260 according to the principles of 
the invention. If the user issues a sort command specifying one of two sorting schemes, i.e., a sort in selected order 
and a sort in order of time, then the sort si±)routine 266 is invoked. If the sort in selected order (selected secjuence) is 
specrf ied^.the CPU sorts the clips in the selected. wder^ile keeping the order of dips selected by adrag asthey are. 
[0070] ^ For this purpose, the SELECTED 6m^iiyi^5^8 of the scene table 520 are filled with "1 M at the time of 

40 creation of the record and thereafter updated each time a selection or uriseiectioh command is executed as mentioned 
above in connection with FIGs. 15 and 16. Specifically, in an unselection operation (step 304 of FIG. 1 5), for each of the v 
specified .scenes, the CPU decrements the y^M^ ? ^l^M'$^^?^ : order fields 528 whose values are larger than that of 
the specified scene and writes a value "CT in i the selected or^ef f^lds" 523 of 'the; specified scenes: Also, in a selection 
operation (step 314 of FIG. 16), the CPU sWc^^ tfeiel^ for the maximum value; and writes the 

45 maximum value plus phe in the selected order fields 528 of the sp^rfieki scenes thii enables clip sorting in the 
selected order. '/ ';'" _ ; [ ' ;*' v ;* . "\ ; ' • ;: 

[007i] Again in HG. 17, if the sort in time sequence 1 is^ecifj^V'^ 16 ! s^rte only the order-sensitive clips (i.e., 
selected order-sensitive scenes and selected groined scenes 'each indu&ihg at least one order-sensitive scene) in 
ordej "of time while keeping the order of the rest of the clips in step 266. 
so [0072] Following step 264 or 268, the CPU displays the; sorted I'clips and the uriselected scenes In the scene' difeplay 
area 43 and registers them in a history file 550 in the SceneD^ta directory. In order to facilitate the undo function, each 
time the user executes a command/the record of the commkridV command parameters and a list of the scene (or scene 
index) IDs arranged in order of displayed scene indexes in the scene display area 43 is added to the record list in the 
history f Hie 550. ' ' '' ' V '" : " : ' :; '\ x: r r * / : " >r '" ' * '. ' >r " 



Relative Position Restoration of a Specified Scene * ; 

[0073] The user is also permitted to move a sCene ihd^ from orie wihdowio anbther window in a w6ll-l^dwh v manner 



by a drag and drop operation. In the course of editing process using selections, unselectibnsrand moves, the user may 
sometimes desire to restore a specific scene to its original position. This is not achieved by the conventional undo func- 
tion which restores the previous ^tate^epby st^;^ ' ; - - - v > ^ <:s- \ 

[b074] Recording to the prifc^ a ^ecific sclehe to its relative position with 

5 respebt id> the next scene or file back scene at the time die last segmentation or grouping command has been executed. 
Fdr this purpose; the ORG &eheW&e { 5Z(iiw4 updated ^eachtimea 'segmentation or ^ group- 

ing is executed so as to retain thei i^^^pBd^^eA sc^&irid^^&'shd^'ln step 229 of FIG.-10B arid step '247 
of FIG. 12. Aiso", as practiced' in <»nventi6nai Video Inditing system, the state of the scene indexes in the sc^he display 
area 43 is stored in a history file 550 in the SceneData directory of FIG 5 each time any editing command (e. r Q. t a s§g- 
io mentation, a grouping, a select, an unselect, a move and this restoration, too) has been executed. However, this oper- 
ation is not shown in the flowcharts of the accompanying drawings for the purpose of simplicity. a ' • < f 
[0075] FJG : 18 shows an exemplary operation of a relative position restoration subroutine 250 according to the prin- 
ciples of the irwerttion. if j^e Usfer elides bn a RESTORE button 52 with a desired scene index specified, then the CPU 
enters the subroutine 250: In step 252/bpen a dialog box; iH i whichihe U^er prompted to select whether the specified 
is scene snouid be restored to tne next-pased reiauve position or the bacK-baseci relative position, it the user selects tne 
neit-based relative position, the specified scene is moved to just before the scene with the oixier ntimbef 522 just fol- 
lowing the order number of the specif ied scene. If the user selects 'thfe back-based relative position, the specified scene 
is moved to just after the scene with the orcjer number 522 jusi preceding theorder number of the specified scen£. And, 
the comrol is returned to the main routine of the video-editing program 20. Though not shown in FIG?18; the resiiltaht 
20 state of the scetieS is al^ stored in the history fiie''5^'fojr^^re'und6 'Operation. ' - ; ^ ■ ><- v r 
[0076] v For better understanding the restoration fun^bri^We will take kn example FIG: 19 illustrates* how the relative 
position restoration fijnctipnworte in acbdrdaric row labeled "ORIGINAL ORDER" of FIG. 
19, there are displayed scene indexes for five cdlected rroteriai videbs M1 through M5 arid four narration videos pre- 
pared after the material collection, N 1 through N4? Uhseleirting M4 resufte in STATE 1 , where the^cene index M4 is dis- 
ss playied in a r^uc^<x>ntrast : Movirig 2, where M5 is inserted after Ni. Moving Ml- 'to 
after N2VM3 to after N3, and M2 to after N4 results in ^WIE 3!;And; selecting M4 again Results in STATE 4. If the user 
issues a relative position restoration pbrh'mand; v^ilV^^'if^iig M4, then thfe scene' index M4 is automatically inserted 
affer : M3 b^use.M4'was~qlaced;a^r M3 in the original 'briefer* 1 *' ;t " ' " = ■ " 
[0077] Thus, only a desired scene can be advanta^ its original position without neither changing 
30 the order of the other scenes nor going back step by step'/' rr>; '^ " -''-^W-^ -v . r- 

Clamping a Scene to its Original Play Time r\ r; 

[0078] the user obtains a desired set of ^orderld blijis; j.'ki ^ ^CM*ali§d dip list through an editing process Using abbve- 

35 described various fundions//^ edited video prbgrMifi is ass^^ed from tte the Video directory ori the 

baisi^ of the clip list, which i6 deriv^ frbm the l^ ; r^i^^^ V^rd r< in the history file 550. Generally speaking, the 
as^#mbling is such that video s^gniente correspon^irigltb ^di^'^n^ih^ in .the clip list are ebne^ehateti in the 
listed order so as to adjoin the first (or begin) frame bf^pr%i^^g' : scehe and the last (or end) frame of the scene fol- 
lowing the preceding frame. .... r - 

40 [Q079] FIG. ?p illustrates this proc^iss. )n Fl(| ^ B and C, Le., f a MAIN VIDEO Ais Pig- 

mented into five scenes A.Y, A.£ A.3, A:4 and'^Srtrt^ as^ries of grouping and selection's resulted in three CLJPS 
A. 1 • r B, A.3 • C and A.5, which are assembled into an EDITED VIDEO PROGRAM 1 . ' * v? - « % : ; - 

[$080] However, the user rnay desire ^ 2) a specif ic scene, s&y, 'A3 

should be played in the same timing as in tte^ For this purpose, a kind of CLAMHNC3 OF 

45 A.$ (to the source video A) is performed iii the c»ncat^hSibn of scenes A.t • B and A.3 • C: In this specific Example, 
the scene B has a latter part thereof discarded; resulting ih a shorted scene B' in the EDITED VIDEO PROGRAM 2. 
[0081] Thus, according to the principles of the inyention, the user is permitted to issue a clam£ bbmmand specrfyihg 
one of the.sceneis into which a SDurce vicJ^p hk£ been'l^i^^ed (i.e . 'a divisibnal scene) or a grouped scene that 
begins with' such^a^dMSipnal scene; FIG. 21 is'a exemplary bperatidn of a darhp setting subrob- 

so tine l 270 according, to ;the;phncipi^' of the invention.' Ih step 2^1 , ihe QP'U writes a predetefrmined value in th^ clamp 
f ieid'530 of the scene table 520 associated with the ^ecif ied scene, if ; the specif ied scene is a grouped scene 1 , then the 
CPU fills the begin and end frame fields with^ ^appropriate values in step 273. Specifically, the CPU cbpiies the value of 
the begin frame field pf the first constituent sbfene or the specified scehe to the begin frame fiefd of the specif ied scene, 
and writes the copied yaiue JdIus ^ end frame field of thespecified dcene. 

55 After step 273 or after step 271 if the specified 'scene is not a^rouped scene, thedPU returns to theWteih routine. 
[0082] As described aboy^, setting a value in a ctemp f feldj5$b of [ a divisional sdehe or a grouped'scehe bieginriing 
with a divisional scene causes the divisidhal &ehe'1b v be clamped to the Source video of the divisional scehe. That is, 
the divisional scene is played in the same timing both in the source video and in a edited video program; r - 



Scenejransrtion Processing, i& * • : * -'^v : . ; ■■• 

[0083] The user is permitted to set a special effect on any scene to add an image jeffect to the transition between th§ ; 
scene and the next scene. ,FIG. 22 shows an exemplary p^eration^qf 'a transrtiopaj effect setting subroutine 275. if, thf 
5 us^r issues a transitional, effect getting comniand ^ then the subroutine 275 is 

invoked. In step 277, the CPU displays available image eteqts for ^cene trahsftibns^. e.^ dissolve, fade, and wipe so" 
that the. user can specify a desired one of the dismayed, eff^^/ In ^ep^?79, the CPU writes an effect ID of the specified 
image effect. in a transitional effectJield 532>of toes^'^^^ 
returns to the main routine. ■.■-..,.■> \, ,v : \ zy-< .w .rv;v.V,: : , >: ■ > r ■ 

Video Program Generation • :_ v;;r ; : >- , • ;. , , .. - v . ... v- ■; , .' , ..;* 

[0084] ; After completing a clip list by AgB^ the videq editing system 100, the user 

finally issues a creation or compile command (in user operation step 36) to^cre^te an edited video program 3 according 

15 to the obtained t clip jist (in system step.26) as^howrr in;FICL3. Th^clip list js preferably stored in a file ProgfamX in the 
directory SceneData or in a different directory CLIPS , (not shown)! It is noted that the u$er may create some clips from 
the same source videos. In such a case, the clip files are preferably stored in the different directory. 
[0085] FIG. 23 shows an exemplary operation of a yi^eo program compiler subroutine 28Q called in response to an 
issuance of the creation or.compile command. In FIG. 23 f the, CPU pljps a f irst video.segmerit identified by the first clip 

20 (record) of the clip list in step 281 . In step 282, ,a test is made Jo see if the video segment needs a transitional process, 
liso. the specrtied video effect is-appli^ r .'••:> : . ; 

[0086] Otherwise, or after step 283, the CPU clips toe to the next dip record of the clip 

list in step 285. In step 28£. a test is made to see if„Akcurren^ to be clamped. If so, then in step 287 the 

CPU trims the previous video segment so that the ei$ ^ program being 

25 -compiled is smaller by onethan the value of the begin f r^me t f ied pi. thecijp record of the current segment. Otherwise, 
or after step 287, the CPU ^catenates the current s^n^nt tp tog preyipus segment in step 289. then, in step 290 , : 
a test is made to,see if the current segment needs a transjtioi^i process, if so. the CPU applies the specified video 
effect to the segment in step 291. Otherwise, or after st^ ^trthe.Cr?U maizes a test in step 292 to see if the.ciips in 
the clip list hav<e been exhausted., If so, thep fhe CPy,returns.ta the pPU returns to step 

30 285 for the next clip. Thus, an edited video program is generated.. r . ' ,/ 

Embodiment II , ; v ..'«- 

[0087] ^The second.illustrative erribodimentof thejnyentjpn is basically toe same as the above-described first embpd: 
35 iment except thai : the^ispjay .screen £0a of ; toe r s^ndi^ only the scene display area 43 including 

the scroll buttons 44 and 45 but also a clip display ar^^i^lMding scrolj buttons 54 and 55 as shown in FIG. 28. Sihce 
^toe scene indexes (of ihe unselected ,scen^).'arri"the' ciifj ilexes (of the.seietfed scenes) are displayed in serrate 
.areas 43, and 53 in the second : embodiment J^isJl^iita^s bpth the Selection of scenes and trie arrangement of the 
order of the clips. ... \ 

40 [0088] The foMowingdescription will be focused on the differences between the two embodiments. , 

[0089] [, JritF.IG. 3. the selected scene index^ or c^ toe/scene display area 43 but. in the 

clip display area 53/ " " ; - .« ; c-'^V^ ^ v-n i ■■■ -i- 

:[0090] .The data-related directory c^ are discriminated 6y 

the select field of the scejfie, record' for the scene or pjip ^^ ^e^n. to^ scene and clip indexes may be stored in the 
45 same directory Scenelndexes. For thet same reason, the scep<3 ^l#.^?0 contains the records for both the Scenes and 
the dips. For the purpose of simplicity, the term "scene (^fo^ be us^ for a record of either kind regaidless of 
whether the record is .for scene or clip. ' V ■» -vl- '-t-^^^A- . °\ > ' \ 

[0091] In the first embodirnent, eaych recordof the hi^pry fije.S^ 

and a list of the scene, (or scene index) IDs arranged in o^er^oi, di^ayeil icene indexes in toe scene display area 43; 

so and the list piscene IDs includes both the scene IDs and the^ histpry file 

according to the second embodiment is comprised of ia^^irii^^! 'c^mrrancl. |Mraymetefs'..a list of the scene (or sc^ne 
index) IDs arranged in order of displayed sc^ne ^ indexes, in s^e Jiispiay area 43, and a list of the dip (or clip index) 
IDs. arranged in b order otdisplayed clip indexes ia toe di|?^is^ : 
[0092] . A video editing system according tp.the i secbrxl iljusfrativelen^ the same functions 

55 as the above-described system : 100. Since ty/p yided display areffi^ej^l|^le..ihe capability of the system will be 
listed with the availability toereof in the scenea^ ^ - t , r 

[0093] In the fdlqwing table, 0 "denotes availabiiity ■ "of. a corresponding Unction and x denotes unavailability of a cor- 
responding function. v ^.;, ... , , Vv - ■ w V ^ --.v.- : ^- V w ■ " ^ • 
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r : , , , , ^ .Functions 


Scene 


Clip 


v- :> a) browsing with next and back :i<^!^^.n^pr.;aTCroU bjar-:. 4r j =,.,*.;.... * r y. 


- 0 \ :; 




b) recursive scene/clip segmentation available with the browsing function 
v c) scene/clip spectficat^ ■ . ] ■ 


o ^ 


.... p 


d) recursive scene/clip grouping — ^ h : - : v - v v-. - . - 


0 


^ 0 


e) scene clipping based on unselection by default. ; 


v v's ::uhseTeet v^-k- -: 


o^ ,v 


X 

? 0 


. f f)clip sorting , ^'"^V." ".TV ,' t /"LV-s'^V*-.^ ' n '" 7'." '.' 


; ' x 


v 6 




X 


X 


h) clamping a scene to its original play time (setting) 


X 


0 


; i) scene transition processing (setting) 0 : - c . 




, ;: p .. ; 



[0094] ^seen in the above table, a) browsing, b) scene/clip segmentation, c) scene/clip specification with a reversing 
option (, which wiM be defiled later) and. cfj I >ecufeive Stehi^ifc s^m^ritaitibn are available both in the &ene and clip 
display areas 43'and 53 arid achieved In'lhe's&fite^mciriiier' asiri 'tHS f fast embodiment : ; f ■ - ? 
[00951 ; However, if a grouping is performed in the scene.display area 43, the resultant grouped scene is taken to be 

25 selected and accordingly displayed in the clip ^ispi^y "ar^;^ That is, the seltect field of the scene record for the 
grc^ied.^hejs'sk^ "XT-". L - " - «• • 5 — ■ w-s,-- , ■ , : -v<; 

[0696] The relative position reparation (g) not ^vail^We in (f). the damp setting 

(h) and the setting of scene transition processing (i^air^d^ldbtle only In We 1 clip display krea 53, Jl ahd achieved in the 
same manner as in the first embodiment ^ • n ^ : v; ; j ^ n ■ ^ \ - 

30 ■ ■ - ■ v y .'M : 

Scene/Clip Specification with a Reversing Option. % ;': ^ * v '^^f ?: ;' •'" - ; ^ 0 . - v ^ : * .t : 

[0097] According to the principles of the ! invention, once ^ or niore stfeines or clips in the scene 

43 or clip 53 display area, J^e user ^ or clipfc. FIG. 24 is a dia- 

35 gram illustrating how the spedfied/uhsp^cified states 6f tfie^cehes or clips, are reversed. It is assumed that the user 
h£|s r specified. scenes (or dip^} A, v B and M as shi%n"b^^ user reversesthfe state by 

mined .sin^le^pperation, th^^ frbm S/U" ^fe^l ib^jj ;state . '£ in Which bcen^s C, D, J, K, L are specified. 

The user can again reverse the state, resuming iri the^S/U ;^^t^ r i Ij^is elri^>1 es^lexibl e sbene/ol ip ^>ectf i oaltions; raising 
the editing efficiency. . . '■ :[ '" f ' : { -'- : 1 " r: - v J ; 

Scene Clipping based on Unselection by Default v 

[0098] All the scenes are first displayed in the scene display area '43 ^ with ho frame displayed in the dip display area 
53 as long a clipping or a grouping, which involves clipping, is not performed. That is. the clipping operation 6f the 
45 embodiment is based on a unselection by default scheme. 

[0099] FIGs. 25 and 26 are flowcharts shdwiriig ^xenplary bpefatiohs of a selection subroutine 320 and a unselection ; - 
subroutine 330 according to the principles of tiie invention, 

[0100] The selection operation 3i>0 of Fib: ^5 is icJehiic^i to tl^att of FIG. 16 exbept'step 326. In step 326, the CPU 
moves the selected scenes Jrom the ; 6cene display area ^ to t^ ^ 

so [Olbt]^ Since an gnselectipn is perform^ on %e^ area 53, steps 3S2 and 334 of FIG! 26 are 

identical to the corV^qi^ing';steps of FIG; 15 H scenes are chknged to clip's iri ste^s 302 and 304. Further, in step 
330, the CPU moves jrie sel ectedTcl ips f rbni th^ cli^ display area 53 to the scene 5 display area 43. - 
[0102] '\ FIG. 27 is a diagram showing an ^artpjeqf a sdeneiele^on in which a selection command is Executed after 
reversing the specif i^/unspe£ifj^&^^ 27. SCl indicates that scenes A and G are selected. If 

55 the user issues an selection OTmrnahd in state SC1', it cau^ihe sfete CLi in which clip indexes A and G ar6 displayed 
in, the^ dip index display area 53.. If frie us<5r issues an selection command after reversing the state.CLI , then it causes 
the state CL2 in which clip indexes" B, C, D t E and F are idisplayed ih theclip di^5lay area 53. : :; 

[01 03] In this way, combination of the flexible scene/clip specification function and other functions enables ah efficient 
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video editing. 
Modifications 

s [01 04] Though a scene browsing has beeaperformed on a single scene jo.theabqve example, it is apparent to those 
skilled in the art that it is possible to browse a plurality of specified scenes regardless of whether the scenes are con- 
tinuous or separated."" ' ~ v-y; ^^i?'-/ ^'fey ^ )Zv&.T'&z'->« •i-V-^, •^'^'.-vr 'V- v " " 

[0105] Many widely different embodiments of the present invention may be constructed without departing from the 
spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific 

io embodiment described in th^ ; 

[01 06] A video editing system has the functions of : a) scene browsing with next and back icons and/or a scroll bar; b) 
recursive scene segmentation available with the browsing function; c) scene/clip specification with a reversing option 
(in case of a system with two display areas ); id) recursive scene grouping; d) scene clipping based on selection by 
default; e) clip sorting in order of time or inaspecified order; f) relative position restoration of a specif ied scene (in case 

is of a system with a single display area); g) clamping a scene to its original play time; and h) scene traihsitioh processing. 

Claims "" ' ' ' " ' * • ; ■ ■ ■ - - - • 

1 . A method for generating an edited video program from at least one Source video in a computer-based video editing 
20 system, comprising the steps of : " " w "'" 

^creating a record.'for each of said at least one spurce y)dep r cpntsuriing information on each said at least one 
video including a number of frames cbhstiM^ records .'for said at least one video constituting 

. a record set; , : t -.-.■«-./ , r ,^v- .". , ■ I .- .... . . ' ^ 

25 searching a user-specified one of said at least one video for begin and end frames of each of video segments J 

constituting said user-specified video to add, to said record set. a record of each said scene which jncludes aP 
r „■ . begin frame .number and an end frame number of each said scene, hereinafter, videos and video segments 
. defipedby said records, being referred to, a^ ;. 
displaying a frame representative of each said scenes (hereinafter, referred to as "index") in a display area 
30 comprising an array of small windows; 

permitting a user to segment a desired one of said scenes; 
permitting said user to group desired ones of said scenes into a grouped scene; 
: in response tasaid segmenting aruisaid grouping, updating predeterminedjields of records which contain an , 
. . V order of said scenes so tr^ 
35 ; permitting said useir to select desired 

^permitting said user too ' \ 

in .response to a first cpmrnand said, user isfsues,vyhile^specif ying one of displayed Scene indekes, restoring said 
- specif ied scene ind,ex to a relative position yvM index which said specified scene index was 

adjoining at a time of occurrence of a predetermine 
AO in response to a predetermined command from said user, compiling said edited video program on the basis of 

said clip list. : ; v , 

2. ,A method as defined in claim 1, wherein said predetermined event is a later one of a last segmenting and a last 
- grouping.. : ..... ... \. : - : r . " ' K.^/. : ^C<' - "1, .', . - , ... . 

3- A method as defined in claim 1 , wherein said step of restoring said specified scene index comprises the steps of: . 

, prompting said user to select whether said specified scene index should be restbred'to a next-based relative 
position or a back-based relative position; J . . " Tv-VV-V' ..' 
so ,, . in response to a selection of said next^ased rel^tiyejp^ scene index to just before 

, a scene index with which a value of : said predetermine aX^prd'-a^'ociat^ j^ larger by one than a f 
value of said predetermined field of a record ^associated [with said specified scene index; and 
/ in response.to a selection of sajd back-based, relative ^sitibn/ moving said specified scene index to just after 
a scene index with which a value of said p'red^errpined f ield of a record associated is smaller by one than said ^ 
55 . value of said predetermined field of said record ass^iated with said specif i^ scene index. 

4. A method as defined in claim 1 1 wherein said step of permitting said User to setect desired ones put of said indexes' 
as clipjodexescprrprisesthe steps of: ^ 7/ ... ' . . ! : V ■ . y ' ." . - ^ " ' * ' 
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>r in response to ian uhs^lectiori command said user issues while specifying desired clipihdex(es>inra state of all 
being clips due to selection by default, changing said specified dip index(es) to scene index(es); and 
v in response to a selection cxDmmand said user issues whife ^ specifying desired onie(s) of said scene indexes, 
changing said specified scene index(es) to clip index(es): ; ^ ' v - i;! v r " 7 > ■ • • , i 1 '\ 

5. A method as defined in daim 4, wherein said step of Changing said specified dip index(es) to scene index(es) 
includes the step of changing a normal way of displaying said clip index(es)'to other way ahd wherein said step of 
changing said specified scene index(es) to dip index(es) indudes the step of restoring said other way to said nor- 
mal way: y: ■'' >'-^ r: 5-'< v : ,4 n.-- ; :: : ;;, ^s^A:ol3^;a3; ; ^^.K:^ .". V . -\ . 'oc^v.-:?* A 

6. A' method "as defined in claim 4, ; wh'efeiri l^id is^ep of permitting said user to select desired ones includes the step 
of permitting isaid liser to specifying said changed specified clip index(es) as said specified scene' mdex(es) to be 
selected. "" :v s: - : " : - ~ ; - ^ '•• - *' ■ r-^pln;:: .r..-'v.--; rJ. -* T .r. Kr^-cxi: x^, 

7. A method as def ined in claim %, wherein' said step of permitting' said user to select desired ones includes' the step 
of permitting said user to specifying said changed specified scene index(es) as said specified clip index(es) to be 

unselected. - ' 4 -- ■ --^ • ■' - 5 ^- ■ i- *• ;. ■■■ r>\. ■ : ,, ; 

8. A method as defined in daim 4, wherein said step of changing said specified dip index(es) to scene index(es) 
^ includes the step of updating predetermined f ields'df said records i so that said predetermined fields retain values 

indicative of ah order of selection of respedive ^sceric^ ahdCclips, whereiin said step of changing said specif ied 
scene index(es) to dip index(es) indudes the step of updating said predetermined fields of said records so that said 
predetermined fields retain values indicative of an order of seledion of respective scenes and dips, and wherein 
the method further comprises the step'of: ' " i: * , : ;i;->--.,.. -\. .\ 

in response to a cbrnmahd to order said clip ihde*es r in a selected order} sorting said dips 1 in said selected 
order - ••>• y. .< i 

9. A method as defined in claim 8; wherein said step of sorting ^id cli|»s in said selected order includes the step of, 
if there are dips' selected by ai drag bperatidh; keeping a curiert-ortter of said dips selefded by a drag operation as 

it is. " •, v.-;. w }.-~h,:r;- :•• 

10. A methbid as def ined iri daim 3, further-cdrhprisihg the ^steplof in r^pbnse to a corhrmhd to brcfer said dip indexes 
in Srder of time- sort ng said clips in order of time, ^-v^*^rr#ss -^^xt v :':-. l- ^ .-c v ^ 

11. 'A' method as defined in claihi 10, wherein ^id step of sdrtihg -said dips in order 6f time indudes the step of , if there 
are dips selected by a drag operation, keeping a current order of said clips selected by a drag operation as it is: 

12. A method as defined in claim 1; further coriprising the ^p ^ specifying a desired one of 
said scene indexes and assigning said specified scene index one of predetermined transitional effects, and wherein 
said step of compiling said edited video program includes the step of applying said assigned transitional effect to 

r said specified scene index; •• * ' :n err* 2 v^* v ■ : -' v.'. \> : ;/ v. a .;\- 

13; % method as defined in claim 12, further comprising the step of selecting a dissolve, a fade and a wipe foresaid pre- 
determined transitional effects. - ^ ; : = ■*-.-.. * r> 

14. A methbd for generating ah edited video program i frbm : at least- one source video in a computer : based video-editing 
system; comprising the steps of: - ' ' ^ v r j ; v v "> •/ : \- ; ; v^j 

^ " ■ 'i ■ 

creating a record, for each of said at least one source video, containing information on each said at least one 
videid including a number of frames constituting -the video; said records for said at least one video-constituting • 
a record set; ? ^ j 

searching a user-specified one of said at least one video for begin and end frames of each of video segments 
constituting said user-specified video to acid; to said redbrd set. a record of each said scene which indudes a 
[ * begirf frame number ^ arid arV end frarne hunger of -each said "sciBhe (hereinafter, videos'and video segments 
^ def ih^ by s^id ; records bdng r v - r ^ -- ; : ^ % 

( displkying; for each kaid sciehes; : a frame representa^e bf said Scene (hereinafter; referred to as M a scene 
index") in a display area comprising an array of srhall windows; ^ : " ri - ^ * ' - 
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. : :; in response to a;command;to-viewTa^cene indicated, by ; a scene ijidex specified by a user (a user-specified 
scene), displaying awiew window, at e predetermined rela^ respective to t said user-specified 

scene index, and displaying*, in said view.wjnclpw, a irgwe ol ( sai<^user;specified scene while changing a posi- 
tion of said frame according to a control by said useir;; 1 r ; \ * .'. ^ a V. 
selecting desired ones out of said indexes as clips; 

• ordering said selected iridex^^^ ? !r v -. r 

; compiling said edited wdeoprograrn^n th^basis p^ 

1 5. A method as defined in claim 1 4, wherein said step of displaying a frame comprises the steps of: ^ 

- ? displaying a frame of said userrspecif ied scene identified by a preset initial frame number in,said view window; 
: in response to an input caused by ^n ; operation, bysaid user, of a switch icon attached to an icon defining a 
movable range of said switch icon, displaying, in said view window, a frame of a frame number calculated from 
said movable range, a relative position of said switch icon and a number of frames of said user-specified scene; 
; : in response to a first input caused by an operation, by said user, of a first icon, displaying a frame just preceding 
1 said displayed frame, in said view window;. , : - . : ^ . 
in response to a second input caused by an operation, by said user, of a second icon, displaying a frame just 
following said displayed frame in said view window. 

1 6. ^ method as defined in claim 1,4, further comprising the step,pf, in response to a reception of a pr^etermin^ input 

entered during said displaying a frame* segmenting ^ making said displayed frame one of 

a- two boundaries, , . ^ ; ..,-ij.c.-*\ Zivi^^jvs oci- x^i* .v:>- .. ,. ; ■ =■ • 

17. A method as defined in claim 16, wherein said step of segmenting a frame comprises the steps of :, ^ 

prompt said user4o select whether said frame should, be made,;ap end frame of a former segment or a begin 
frame of a latter segment; 

in response to said selection, adding a suitable frame number to a queue; 
. ;if said ; user : desires fu^her seg - . 

;v- . ; jf said user ; desjres no more segmentation s pertorming segmentations of said userrspecified scene according 
to contents of said queue. 

18. A ;methpdvas defined in claim 17 r wherein saki^step userrspecified scene 
includes the step of automatically naming segments resulted from said segmentations by appending a delimiter 
and a sequential notation to an ID of said user-specified scene and wherein the method further comprises the step 
of permitting said user to specify one of said segments resulted from said segmentations as said userrspecified 
scene. . ; y, 7.1.^ •• ; ■ ; ^V::^-;^-^-- - ,* • . * .■ ■ • :: ,-\.'^ v ., .. 

1 9- , A method as definedin claim 1 wherein said displa&ng a frame includes displaying a plurality of, frames including 
< said displayed frame. v + . K ~ V^^^^r^^h.- 5 :., -v- a - - ■ . s • '...-«■ 

20. A method as defined in claim 15, further comprising the step of, at a time of creating a record for said userrspecified 
scene, setting said preset initial frame number in a pointer field of said record, and wherein said displaying a frame 
of said user-specified scene includes the step of pb h teining;said.preset initial frame ^umben from said pointer field 
of said record of said user-specified scene. ^.m 

21 A method as defined in claim 20, further f comprjsing the ;St€iR,pfr in response to.aqhange.of the frame number of 
said displayed frame, storing a frame number resulted from said change in a field associated^ with said user-spec- 
ified scene. 

22. A method for grouping a plurality of video scenes into a grouped ! s^ene in a comput^-based video editing system, 
comprising the steps of : 

; -j, 'Permitting a user to specify desired ones of sai4^de.o>^e^es; 0i . , : }v . : .,. , : 

in response tp : saidjspeci ( fying desired ones of said^yid^ scen^^and a reception of .a predetermined com- 
mand, adding a record for said grouped scene to.a record set comprising records of available video scenes and 
including IDs of said^specif ied video, scenes in a f jeld df said added record which is for containing IDs of scenes 
constituting a scene associated with said! a<Wed record; " . . [. / J r v , 
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adding an r index indicatiyeof said grpuped.scene to an index set comprising displayed indexes of available 

scenes; and * " ^' m y* l ' m '*jV.'/?S. .'^"*'J> • ' r \ •"'*•. 

deleting indexes of said user-specified ^enesfrom^ , JV , ' ' \; " 

A method as ^ defined^ in claim jp* whe^ index ^ ^^prises ;thfe step of selecting, for said 
index indicative of said grouped scene, an index of a scerte with whicri saragro^^ scene begins. ' 



24. A method as defined in claim 22., wherein said step of including said IDs in said field of said added record includes 
the step ofkeeping the order <^,|^jps!jh&san^ : as that ^j^Q^^^id' user specified scenes. 

25. A method as defined in claim 22, wherein : sajcj step b^f in<^udir;g i ^d jpsjn^'^lcl f iejd pf said added record includes 
the step of, further in response to an indication that ah order, of cpristf^eni^scene bf said grouped scene should be 
in order of selection of said user-specified scenes, arranging . ap orderpf raid IDs in order of selection of said user- 

-spedfied.scene^v-.- .,. ...-^ ~, -v*? ^ [ ~V_ - ."*"_ \,. : .[[ VAY^:>*-1\- ■ 

26. A method as defined in claim 25, wherein said step of arranging an order of said IDs in order of selection of said 
user-specified scenes includes the step of, in the event said user-tspecif ied . scenes includes scenes specif ied by a 
drag operation of a mouse, keeping an order of said scenes specified by said drag operation as it is. 

20 27. , A method as defined in claim $2, wh^ record includes 

ttye; step, of, further in response to an indication that an !p^er'c^.^j^tuer^ scene of Said grouped scene should be 
jn_ oixler of time se^ an order of said IDs in order of time sequence of 

said user-specified scenes if said user specified scenes have be^n derived from a single vjcJeo^ 

25 28. A method as defined in claim 22, wherein said step of including said IDs in said field of said added record includes 
r the step of, further in response to an indication that an or;der of 'c^n^tuerff scene of ^d'grouped s;cene should be 
in order of time sequence of said use^spepifj^cl ^enes and in re^ said user specified 

scenes indude other scenes than scenes derived from a single scene, for arranging only said "scenes derived from 
; a single sqene in order of time.sequence while keeping an.ord.er .of said other scenes as it is.. 

30 ' ' * ""' " * " ' ~" ^:\?.._ ; *' J . ; 

29. , A method as defined in ; claim 22, further comprising the sjep pf permitting .said user to include at least one of said 
grouped scenes in said user-specified scenes. \' : , 

30. In a computer-based system for generating an edited video program from video scenes including video segments 
35 derived from a single source video, a mefripd for y causipg;a start time, in $ajd edited, video, of a user-specified one 

■-. of said video segments to be the same as that in said single source video (hereinafter referred to as "clamping said 
user-specified video segment to said single source video"), comprising the steps. of: .„ 

, ,.- iaresponse to a cojtimand tocla^ in a predetermined field of a recprd 

40 : as^tiated with said user^ecffi ; :v V;" 

.compiling ^id ^rted;yidep prograni on said step of compHing^said 

edited videp^program including the.steppf: ; ,. [ iVJ /: . tl .. , L ' 

; trimming a scene just pra^ 

45 scene in a program being compiled is smaller by one than a .value of a begin frame field of said recprd 

associated with said user-specified video. 

31 . A method for generating an edited video program from at least one source video in a computer-based video editing 
^ system, comprising the steps qf: - f >. ^ : \ : ^ ; (> ; ,,^,„ _ ;V , . . .,. t : - . * r ■■, 

so 

creating a record, for each of said at least one source video, , containing information on each said at least one 
video including a number of frames cgnsti^cig : :the.yidM l: -,said records for said at least one video constituting 
- record set; - « - . . c ; :? . , : \ ^ ' ,., , '.' ." V' . 

searching a user-specified one of said at least one video for begin and end frames of eaph of video segments 
55 ; v ? constituting said user-specrlied video to add. to said rpcord set, a record of each said scene which includes a 
begin frame number and an end frame number , of eacti said scene, hereinafter, videos and video segments 
3-v :• defined by said- records being r^^ed.tq : 9s, M raid 7 scenes ,, ;. ...... - ^ . 

displaying a frame representative of each said scenes (hereinafter, referred to as "scene indexTi in a first dis- 
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play area conprising an jarray of sm«all windows; 

displaying a frame representative of each of selected ones (i.e. 7ciips) of said scenes' (hereihafter^Veferred to 
as "clip index**) in a second display area comprising an i afTay of smalVwindows; 
permitting a user to segment a desired brie 6f siaio ^ scenes or clips; ; ' v ' 

5 permitting said user to specify desired ones of said indexes to make said desired ones in a specified state and 

remaining indexes in a ndh^iecjfi^ to specify desired ones including 

the step of: """" : ! - ' - ^ ' • ■ ° iV - : *' v -- ■•■'*■-- ■ - =-.m- ■ ■■■ r * 

; ft^her permitting s^ " : " ' 

70 in response to said stepfof permitting said User to specify desired onfes arid a grouping command, grouri- 

: , ing indexes in said specified state into, a grouped dip indexes; . , 
j ' ;mr^)pnsetosaid sfef) of 'peri^ and a clipping commarxl, chahgihg 

'Vil scene indexes in ^id spec^^^ ' ■■• _ • ' " ' ' 

; ' pefrnittirig said useftd order said clip indexes to yield a clip list; ; ■ 

is in response to a predetermined command from said user, compiling said edited video program on Hie 

.., f basis of said clip list 

32. A system for generating an edited video prpgr^ from at least one source video, com 

20 means for displaying information used in an editing process, said means having a first area comprising an array 

of windows for each displaying a frame refxesentative oif eich of available scenes constituting said at least one 
source video (said frame being" herdnafterVefeit^d 7 '^ "as : "a' ^enelnde^") ihd a 'second area comprising a- 
smaller array of windows for each displaying a frsime representative of each of selected ones (i.e., : ciips) r of said 
scenes (hereinafter, referred to as "a clip Index"); ^ v - - 4 • ' v:: 

25 means for containing records associated with said scenes, a record of each said scene at least having fields 

"\ of ah ID and a l number bf frames; for the " [] " ' • ' ? 

'/ \. specifying means for permitting a user to spWify desired ories'bf said indexes to make said desired ones in a 
„ \ specified state arid remaining indexes m a nbnspe^ 1 

30 means responsive to a predetermined iriptrffrbm said user; for reversing said specif ied state and said non- 

specified state; 

means responsive to said specifying hearts arid ai grouping comrriarid for grouping indexes in said speci- 
fied state intoa grouped clip indexes; ■ ' 

means responsive to said specifying means and a clipping command for changing scene indexes in said 

35 Vsp^i^".stat^to l": : y : '. :7 '^y^ '''' / ' : " - { " 

^ rne^ns for. perr^irt rig s^ ^ ■" ■ 

J r means, responsive to a r predetermined corrirriand frorn said user, for compiling said edited video program 
on the basis of said clip list. L > > ^, vt . ^ t .\.-- M - t - • . ; 

40 33. A systerri as def ined in claim 32! further cdmprte^ to a comrnarid to view a scene indicated by 

a scene index specified by a user (a user-specified scene), for displaying a view window at a predetermined relative 
position with respective to said user-specified scerie index, arid displaying/ in said view window, a frame of said 
user-specified scene while changing a position of said frame according to a control by said usetf 

45 34. "A system as defined in claim 33', wherein said rrieahs : '^Fdt^layih^a*frame includes means for displaying a plural- 
ity of framies inducting said displayed frame. -—•^ v - i ; • . . ^ 

35. A system as defined in claim 33, wherein said means for displaying a frame comprises: 

so means for displaying a frame of said user-specified scene identified by a preset initial frame number in said 

view window; 

' means, responsive to an input caused by an operation, by said user, of a switch icon attached to an icon def in- 
1 ing a movable range of said switch icon, for displaying; in said view window, a frame of a fram^ number calcu- 
? lated from said movable range, a relative position of said switch icon and a number of frames of said user- 
55 . specified scene; ; '' ' : r ' ' " ' : "; /' " t * '\ ri • - : ; % 

rnesins responsiveto an input Caused by an operation; by said user- of a first icon, for displaying a frame just 

preceding said displayed f rime in said view ; windbw; an^ - 

means : responsive to an input caused by an operatidn^by said user, -of a second icon, for displaying a frame 
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" ju&tollcwng^ x- ? ; .v v r;y% = — ; 

36. A system as defined in claim 35, further comprising means activated at a time of creating a record for said user- 
specified scene fbr setting said preset initial frame number in a pointer field of said record, and wherein said dis- 

5 playih'g a frame of said user^spMfied scehe-ihcfudeis m^ris- forbbteihing said preset initial frame. number from 

saidpfcihteffl - . -v • 

37. A system as defined in ; claim 36; further cbiriprising m^hs- responsive to a change of the frame number of said 
displayed frame for storing a frame number resulted from said change in a field associated with said user-specified 

io ' sbeneforresuming a current vfew. ; r> -- ^^-^ ^':-; : :;-.v:-: ... ^.-./ 

38. A system as defined in claim 33, further comprising means, responsive to a reception of a predetermined input 
enter enduring said displaying a frame/ for segmenting said u 

of end and begin frames. 

39. A system as defined' in claim 38, Wherein said means for segmenting a frame:<»mprises: '"• > - > 

L ' mearisfor prompting said user to selekrt whether sato^ 

or a begin frame of a latter segment; t<- •. 

20 ; means responsive to said selection for adding a suitable frame number to a queue; 

meiaris, activated in the event 'said userd^ifes further 
* \ rfiearts, activated in the event said user desires no more segmentation, fbr performing segmentations of said 
J user-^eicif ied scene iaccbrding tdcdnfe^tff said v quetie.^ ? - - : " - ' Tf r 

25 40/ A System as defined in claim 39, wheWnSiid means for performing s^mentatibn scene 
includes means fbr automatically naming segments resulted from said segmentations by appending a delimiter and 
a sequential notation to an ID of said user-specified scene and wherein the system further comprises the step of 
permitting said user to spedfy ohe : of ^ said user-specified 

scene. * ) : .: -i.-.- 

30 

41 ; A system as def iried in claim 32, wherein said [means for grbupihg specified indexes into a grouped clip indexes 

'"'comprises:" "" r ' A ''• ' *' ' - : ' s/ - - ^.v;--?,*-. •■:?t-^v atf? •: r- :■ ■■■vr.r^~-> - ; ;•: . , ; <, : - v 

means responsive to said specifying means and a reception of IDs of user-specified scenes for adding a record 
35 for said grouped scene to a record s^t comprising records of available video sdenes : and including said IDs in 

a field of said added record which is for containing ID of scenes- constituting a scene associated with said 
added record; 

mean£ fbr adding an index indii^tive of satidgr^ comprising displayed indexes of 

' available scenesi'and 1 ;; J ' ' &u^t'&M : -.ri •:,;•/•*> ■ . .- -•: 

40 means for deleting indexes of said user-specified scenes from said index set. 

4?. A v system as defined in claim 4 i , wriereih said means rferSdding an index conr^rises means for selecting, for said- 
index jndicativie of said grouped scene; ah index <^;a^4h'§ t with , ' which 'said grouped scene begins;' v. 

45 43. A system as defined in daim 41, 'wherein' ^id *mearis for inducting said IDs in said field of said added record 
includes means for keeping the order of said IDs the same as that of indexes of said user specif ied scenes! 

44. A system as defined in claim* 41 /wherein said i means forTriduding sad IDs in said field of said added record 
includes means, further responsive to an indication that an order of constituent scene of said grouped sfcene should 

so be in order of selection of said user-specrfi^^cenesrfor arranging an order of said IDs ih order of iselectibn of said 
user-specified scenes. s *» r • ^ ' - * . f ^ 

45. A system as defined in' claim 44. wherein said means for arranging an order of said IDs in-order of selection of said 
User : specified scenes includes the step of. in tKe event said user-specified scenes includes scenes specified by a 

55 drag operation of a mouse, keeping an order of said scenes s0ecHietfby said drag operation as it isr 

46. 7 A system as defined in daim 41"; wherein said means foMnduding said : IDs -in £aid field of said added record 
includes 1 means,' farther re^ohsive tb'ari indication that ari order of constituent scene of said grouped scene should 
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be in order of time sequence off said user-specified sqenes, v fQr? arranging an qrd^r of :i s^d ; ips in order off time 
sequence of said user-specified soenes if said user specified scenes have been derived from a single video. 

47. A system as defined jrif claim ,41i wherein : ;said meaqis t fp^ iniqltding ^id IDs jn^sdd field of said^ added record^ 
s , includes means, further responsive to an jndjcatiqn that an prdei; of constifeent scene of said grouped scene should 
be in order of time sequence off said user-specified scenes^nd^ defeririination that said u^er-spec- 

Hied scenes include other scenes than scenes derived from a single scene, for arranging only said scenes derived 
from a single scene in order of jftme sequence ^ ... . ( 

10 48. A system as defined in claim 41, further comprising means for permitting said user, to include at least one of said 
grouped scenes in said user-specified scenes. 

49; - A systemas defined in daim; 32, .whjerein said means for chapging specified scene indexes tpl clip indexes, com- 
prises: . ■ ; .. <v 

15 

responsive to said specifying means and a selection command from said user, changing, said specified , 

Index(es) to clip tndex(es): and 

responsive to said spedfying means an^^unselection cpmrriand from said user, changing said specified clip 
index(es) to scene index(es). ,- f 

50. , A system as defined in claim 49, wherein;S^ to clip index(es) 
I includes means for updating said predetermined fields of said r^rds so that said predetermined f ields retain val- 
ues indicative of an order of selection of respective scenes .and ' dips, wherein said means for changing said spec- 
ified clip index(es) to scene index(es) indudes means for updating predetermined f ields of said records so that said 

25 ^predetermined fields retain values indi^ respective .spenesi and .dips, and wherein 

i- the system further comprises: v- (.^ rv-*.*-*.;:^ ... % , ; . .'■ 

;• means responsive to : a command to .,qrdeF r ^d jdip--iridex^in-a selected order for sorting said dips in said 
selected order. ' 

30 - 

51. ; A system as definedJn claim 50, wherein said means for sorting said clips in said selected order inpludes means, 

responsive to a determination that there are clips selected by a drag operation, for keeping a current order of said 
clips selected by a drag operation as it is. 

35 52. A system as defined in daim 32; further to a command to order said qlip indexes in 

order of time for sorting said clips in,prderof time.^; ,. , ... 

53. A system as defined in daim 52, wherein said rneansfor sorting said clips.in order of time includes means, respon- 
sive to a determination that there are clips selected by a drag operation, for keeping a current order of said clips 

40 selected by a drag operation as it is-. ? ■ :; .. : ,y _. f ^ { , ; ;■ ; r ., ■■■ ••. v , 

54. A system as defined in claim 3?, wherein ^id^ derived from a single source video 
(hereinafter,> referred to : as "derivative, seen es^vfu^w^efein the system further cpmprises means for causing a 
start time, in said edited video, of a user-specified one of said video segments to be the same as that in said single 

45 i source video (hereinafter referred to as "clamping said us^r r specified video segment to said single source video"), 
said, rneansfor clamping said user-specified video segment*^ 

; means responsive to a command to clamp ^ifj^s^r-spectfjied video for setting a flag in a predetermined field 
of a record associated with said use^spedfi^ 
so means for compiling said edited video program pn the k?§sis of records for clipped scenes, said means for com- 

piling said edited video program including the step of : 

trimming a scene just preceding said user-sp^cif ied yideo so that an end frame number of said preceding , 
*■■ .scene in a program being cornpiledJs srralle^by. one than a value of a begin ^frarrie field of said record 

55 associated with said user;specrfiecJ video.. . , , . v . , ; ^ . , , ^ 

55. A system as defined in claim 32, further comprising means for permitting sai^ user ^specifying a desired one of 
said scene indexes and assigning said specified scene index one.ofpr^etermined. transitional effedts, arid I wherein 
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said means for compiling said edited video program includes the step of applying said assigned transitional effect 
to said specified scene index. 

56. A system as defiried ih ciairiri 56, wtiereih Said pred^£rmiheff tra^ Effects are a dissolve, a fade and a wipe. 

57. A system for generating an edited video program from at least one source video, comprising: 

means for displaying information used in an editing process, said means having a area comprising an array of 
windows for each displaying a frame representative of each of available scenes constituting said at least one 
io source video (said frame being hereinafter referred to as "a scene index"), said scenes being to be displayed 

in said area even if they are selected as clips for use in said video program; 

means for containing records associated with said scenes, a record of each said scene at least having fields 
of an ID and a number of frames for the scene; 

specifying means for permitting a user to specify desired ones of said indexes; 
is means responsive to said specifying means and a segmentation command for segmenting a specified scene 

or clio: 

means responsive to said specifying means and a grouping command for grouping specified indexes into a 
grouped clip indexes; 

means responsive to said segmenting and said grouping for updating predetermined fields of records which 
20 contain an order of said scenes so that said fields of record reflect an order of current scene indexes; 

means responsive to said specifying means and a clipping command for changing specified scene indexes to 
clip indexes; 

means for permitting said user to order said clip indexes to yield a clip list; 

means responsive to said specifying means and a first command for restoring said specified scene index to a 
25 relative position with respect to a scene index which said specified scene index was adjoining at a time of 

occurrence of a predetermined event; 

means, responsive to a predetermined command from said user, for compiling said edited video program on 
the basis of said clip list. 

30 58. A system as defined in claim 58, wherein said predetermined event is a later one of a last segmenting and a last 
grouping. 

59. A system as defined in claim 58, wherein said means for restoring said specified scene index comprises: 

35 means for pronpting said user to select whether said specified scene index should be restored to a next-based 

relative position or a back-based relative position; 

means, responsive to a selection of said next-based relative position, for moving said specified scene index to 
just before a scene index with which a value of said predetermined field of a record associated is larger by one 
than a value of said predetermined field of a record associated with said specified scene index; and 
40 means, responsive to a selection of said back-based relative position, for moving said specified scene index to 

just after a scene index with which a value of said predetermined field of a record associated is smaller by one 
than said value of said predetermined field of said record associated with said specified scene index. 

60. A system as defined in claim 58, wherein said means for changing specified scene indexes to clip indexes com- 
45 prises: 

means, responsive to said specifying means and an unselection command issued in a state of all being clips 
due to selection by default, for changing said specified clip index(es) to scene index(es); and 
means, responsive to said specifying means and a selection command from said user, for changing said spec- 
50 rfied scene index(es) to clip index(es). 

61. A system as defined in claim 61 , wherein said means for changing said specified clip index(es) to scene index(es) 
includes means for changing a normal way of displaying said clip index(es) to other way and wherein said means 
for changing said specified scene index(es) to clip index(es) includes means for restoring said other way to said 

55 normal way. 

62. A system as defined in claim 61 , wherein said means for changing specified scene indexes to clip indexes includes 
means for permitting said user to specifying said changed specified clip index(es) as said specified scene index(es) 
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to be selected. 



63. A system as defined in claim 61, wherein said means for permitting said user to select desired ones includes the 
step of permitting said user to specifying said chang^ specif ied scene index(es) as said.^ecif ied dip index(es) to 
5 be unselected. 
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